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1.0  INTRODUCTION 


Recent  rapid  advances  in  the  computer  technology  and  related  fields  have 
greatly  increased  the  spectrum  of  opportunities  for  the  application  of 
computers.     While  increasing  in  power  and  performance,  computers  have  also 
become  more  affordable  and  easier  to  use.     Increasingly,  educational 
administrators  are  seeking  to  apply  the  technology  to  the  administration  of 
schools.     Many  tasks  which  were  once  considered  addressable  only  by  large 
centralized  mainframe  computers  can  now  be  addressed  by  microcomputers.  An 
example  of  such  tasks  is  organization  for  instruction.     School  administrators 
are  becoming  increasingly  interested  in  the  local  application  of  computer 
technology  to  school  information  management. 

Among  the  computer  based  applications  which  exist  for  school  administrators 
today  are  School  Information  Management  Systems  (SIMS)  with  a  particular  focus 
on  student  related  information.     These  systems  may  be  microcomputer  or 
minicomputer  based  and,  typically,  incorporate  four  major  modules  which 
address  school  records,  student  scheduling,  student  attendance  and  marks  or 
progress  reporting.     Usually,   there  is  a  high  degree  of  integration  between 
the  modules  which  means,  for  example,  that  duplicate  data  bases  are  not 
required.     In  most  cases,  the  cost  of  these  software  systems  belies  their 
complexity.     Four  thousand  dollars  buys  multi-megabytes  of  software 
opportunity.     In  all  cases,  it  is  safe  to  assume  that  the  cost  of  the  software 
system  itself  will  be  the  least  impacting  factor  in  any  decision  to  apply  it. 

The  implications  of  staff  training,  human  resource  requirements,  ongoing 
operational  and  systems  support  costs,  and  implied  organization  changes  as  a 
result  of  local,  computer  based  approaches  to  school  information  management 
are  far  more  critical  than  the  mere  cost  of  the  system  itself.  These 
considerations  thus  underscore  the  need  to  give  very  careful  consideration  to 
the  early  steps  of  identifying  a  suitable  system  alternative. 

The  purpose  of  the  work  which  is  reported  on  here,  was  to  develop  a  broad 
evaluation  instrument  through  which  school  districts  and  schools  will  be  able 
to  appropriately  identify  and  prioritize  the  SIMS  alternatives  most  suited  to 
their  needs. 

The  basic  philosophy  which  underlies  the  work  reported  on  here,  therefore,  is 
that  evaluation  as  a  whole  should  be  a  staged  process  which  allows  for  the 
rapid  identification  and  elimination  of  low  potential  alternatives.     To  this 
end,  a  three  level  evaluation  process  has  been  devised  with  progressively  more 
detailed  selection  criteria.     The  first  and  second  levels  of  the  evaluation 
process  thus  serve  to  screen  systems  from  the  time  consuming  and  detailed 
phase  of  the  evaluation  which  takes  place  at  Level  3. 
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2.0    MAJOR  FACTORS  TO  BE  CONSIDERED  IN  THE  EVALUATION  OF  SDfS 


The  only  way  to  reliably  evaluate  the  scope  and  functionality  of  a  SIMS 
alternative  (i.e.  what  it  can  do  and  how  well  it  does  it)  is  through  detailed 
live  testing.     It  is  very  important  to  note,  however,  that  product  scope  and 
functionality  is  just  one  of  six  major  factors  which  should  be  considered  in 
the  evaluation  of  SIMS  alternatives.     It  is  even  more  important  to  note  that 
the  other  five  major  factors  are  collectively  of  equal  (if  not  greater), 
importance  than  scope  and  functionality. 

The  table  below  identifies  the  six  major  factors  which  are  believed  (as  a 
result  of  this  work  and  of  the  District's  direct  involvement  with  SIMS)  to  be 
at  the  heart  of  SIMS  evaluation.    This  table  also  shows  a  suggested  emphasis 
(in  the  form  of  a  percentage)  which  might  be  placed  on  the  six  factors  in  an 
evaluation. 


EVALUATION  FACTOR 

EMPHASIS  (%) 

PRODUCT  SCOPE  AND  FUNCTION 

A5 

EASE  OF  USE  (OF  PRODUCT) 

10 

TECHNICAL  CONSIDERATIONS 

10 

SUPPORT  AND  SERVICES 

15 

PRODUCT  QUALIFICATIONS 

10 

VENDOR 

10 

It  is  significant  to  point  out  that  the  evaluation  process  which  has  been 
developed  can  be  very  flexibly  applied  within  its  domain  of  applicability 
allowing  the  evaluator  to  determine  the  relative  emphasis  to  be  placed  on  the 
six  major  factors. 
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3.0    APPROACH  TO  THE  DEVELOPMENT  OF  THE  SELECTION  CRITERIA 


The  selection  criteria  were  identified  through  the  close  cooperation  and 
support  of  schools  within  the  Edmonton  Public  School  District.     A  six  step 
process  was  used  as  outlined  below: 

Step  1    A  General  Questionnaire  (see  Appendix  1),  Interview  Guide  and  Detailed 
Checklist  (see  Appendix  2)  were,  developed  for  the-  gathering  of 
information  from  the  schools  to  be  surveyed.     These  documents  were 
developed  using  information  gained  through  prior,  extensive  contact 
with  schools  in  general,  through  the  experiences  of  Information 
Services  Branch  staff,  and  with  a  working  knowledge  of  the 
characteristics  of  currently  available  systems.     The  general 
questionnaire  was  designed  to  determine  which  features  and 
characteristics  a  SIMS  should  include  and ,  in  many  cases ,  their 
relative  importance.     Where  measures  of  the  relative  importance  of  a 
criteria  or  characteristic  were  required,  the  questionnaire  featured  a 
simple  four  point  "must",  "important",  "optional"  and  "not  required" 
scale  for  respondents  to  check. 


Step  2    Eighteen  district  schools  were  identified  as  a  representative  sample 
through  which  detailed  school  information  management  needs  and 
requirements  would  be  confirmed.     These  schools  were  carefully  chosen 
to  reflect  many  of  the  key  variables  such  as  school  level,  size, 
programs,  organization  and  operational  style. 

Step  3    The  General  Questionnaire  was  sent  to  the  18  identified  schools 

together  with  a  statement  of  its  purpose  and  instructions  for  its 
completion.     Participating  schools  were  requested  to  give  careful 
consideration  to  their  responses  to  the  questionnaire  and  to  prepare 
for  a  follow-up  interview.     The  questionnaire  also  allowed 
participants  to  respond  to  needs  and  requirements  not  specifically 
identified  in  the  survey. 

Step  A    After  allowing  ample  time  for  the  completion  of  the  questionnaire, 

follow-up  interviews  were  conducted  at  each  school  using  the  Interview 
Guide  and  Detailed  Checklist  referred  to  previously.     The  purpose  of 
this  step  was  to  clarify  and  confirm  responses  relative  to  the 
questionnaire.     The  reason  for  the  two  stage  information  gathering 
process  (questionnaire  followed  by  the  interview)  was  to  allow  the 
schools  to  first  respond  without  external  influence  of  any  kind. 
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Step  5    Information  gathered  through  the  administration  of  the  questionnaire 
and  subsequent  interviews  was  compiled  and  analyzed  and  used  to 
determine  the  relative  importance  of  selection  criteria  items. 
Particular  attention  was  paid  to  the  comments  of  participating  schools 
since  this  sometimes  led  to  the  inclusion  of  additional  criteria  items 
which  might  otherwise  have  been  missed. 

Step  6    Simple  qualitative  and  quantitative  analysis  of  the  questionnaire,  its 
findings,  and  the  results  of  the  interviews  led  to  the  definition  of 
the  criteria  lists  (for  the  three  proposed  levels  of  evaluation)  as 
well  as  to  the  determination  of  weighting  factors  where  appropriate. 
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4.0    THE  SELECTION  CRITERIA 


As  stated  previously,  the  selection  process  Is  defined  as  a  three  stage 
process.     Three  levels  of  progressively  more  detailed  criteria  have  been 
developed  and  are  described  in  the  following  subsections. 

4.1     Selection  Criteria  -  Level  1 

The  Level  1  Selection  Criteria  List  is  shown  on  the  following  page.     This  set 
of  criteria  is  intended  to  be  used  as  part  of  an  initial  screening  procedure  - 
typically,  at  the  point  in  time  when  initial  product  and  literature  reviews 
are  being  conducted.     The  Level  1  criteria  document  defines,  at  a  very  broad 
level,  the  key  characteristics  which  SIMS  should  embody  to  warrant  further, 
more  detailed  consideration.     If  a  SIMS  alternative  under  consideration  does 
not  meet  the  Level  1  criteria,  it  need  receive  no  further  consideration. 
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SIMS  -  Selection  Criteria  -  Level  1 


o  The  cost  of  the  system,  one  time  vendor  services,  and  ongoing  vendor  support 
and  operational  costs  should  be  within  the  bounds  of  consideration  given  an 
assumption  that  the  system/vendor  will  successfully  meet  the 
information/support  requirements. 

o  The  vendor  should  be  a  well  established  firm  with  a  viable  product,  with 
good  customer  references,  and  with  solid  (and  hopefully  local)  support 
services  (e.g.  documentation,  training,  installation,  product  maintenance, 
product  development,  troubleshooting/consulting  services). 

o  At  a  minimum,  integrated  School  Information  Management  Systems  should  have 
operational  the  following  functional  components: 

-  School  Records 

-  Scheduling 

-  Student  Attendance 

-  Marks  Processing 

o  The  SIMS  must  be  able  to  handle  all  students  in  a  given  school  and  so  must 
be  able  to  accommodate  large  schools  of  over  2000  pupils.     It  must  allow 
flexible  formats  for  major  reports  and/or  user-definable  reports  and 
inquiries  into  the  available  data.     The  system  should  have  the  potential  to 
function  in  a  local  area  network  to  accommodate  simultaneous  access  to  the 
system  by  multiple  users  where  appropriate. 

o  The  system  should  not  have  any  processes  which  run  in  excess  of  24  hours. 
If  the  combination  of  the  amount  of  data  and  hardware  capacity  makes  any  of 
the  processes  run  in  excess  of  24  hours,  the  system  must  provide  a  mechanism 
for  breaking  up  the  entire  process  into  smaller  runs  of  under  24  hours,  or 
else  provide  for  an  automatic  backup  and  restart/recovery  at  the  point  of 
latest  failure. 

o  The  system  construction  should  be  parameter  driven  and  allow  the  users  to 
perform  system  regeneration  to  accommodate  local  operational  approaches/ 
needs,  or  the  vendor  of  the  system  should  provide  flexible  and  responsive 
local  support  for  minor  modifications  and  enhancements  to  the  system. 

o  The  system  documentation,  its  ease  of  use,  and  the  availability  of  vendor 
support  should  create  an  environment  that  does  not  require  school  staff  to 
have  special  data  processing  skills  for  day-to-day  system  operation  at  the 
school  level. 

o  The  system  should  make  efficient  use  of  the  available  disk  space  (e.g.  the 
space  should  not  be  occupied  if  a  portion  of  the  data  files  or  system 
functions  is  not  utilized).     The  system  should  allow  the  user  to  specify  on 
which  logical  drive  the  data  resides,  and/or  to  allow  for  a  continuous  file 
space  on  more  than  one  drive  if  the  file  structure  of  the  system  is  such 
that  a  large  volume  of  data  is  kept  in  one  file. 

o  The  system  response  time  on  simple  screen  functions  should  not  exceed  five 
seconds . 
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A. 2     Selection  Criteria  -  Level  2 


The  Level  2  Selection  Criteria  List  is  shown  on  the  following  two  pages.  This 
second  stage  evaluation  document  is  intended  to  be  used  to  determine  whether  a 
particular  system  has  the  inherent  characteristics  and  capabilities  to  meet 
the  needs  of  a  particular  school.     While  Level  1  criteria  defines  the  four 
basic  modules  of  SIMS,  Level  2  further  details  the  system  capabilities, 
processes  and  attributes  that  each  of  the  modules  should  exhibit  (although 
still  in  fairly  general  terms).     For  example,  it  is  at  this  level  that  an 
evaluator  would  determine  whether  a  particular  system  is  more  appropriate  for 
use  at  the  senior,  junior  or  elementary  level.     Level  2  criteria  is  intended 
for  use  at  the  more  detailed  market  research  stage.     This  stage  is  typically 
characterized  by  product  demonstrations,  system  documentation  reviews, 
detailed  consultation  with  vendors  and  consultation  with  users  (reference 
checks).     Product  evaluation  at  Level  2  need  only  be  conducted  in  the  event 
that  Level  1  criteria  are  successfully  met. 
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SIMS  -  Selection  Criteria  -  Level  2 


The  School  Records  Function 
The  system  should: 

-  allow  for  rapid  entry  of  basic  student  data  during  the  pre- 
registration  process 

produce  confirmation  notices 

-  allow  student  identification  at  the  District  and  Ministry  levels 
contain  data  items  required  to  satisfy  school  information  needs 

-  accommodate  a  reasonable  number  of  various  user-defined  fields  in 
addition  to  the  standard  data  fields 

produce  standard  reports  as  well  as  user-defined 
reports/inquiries  using  available  data 

The  Scheduling  Function 

The  system  should: 

-  handle  any  combination  of  full  year,  semester,  trimester, 
quartermester ,  or  6  week  segment  courses  that  are  used  in  the 
school 

-  provide  a  user-defined  timetable  rotation/tumble- 

-  allow  a  flexible  number  of  periods  per  day 

-  provide  a  flexible  scheduling  sequence  (e.g.  A-Z,  Z-A,  lowest 
grade  first,  highest  grade  first) 

-  maintain  current  and  future  year  master  schedules  and  timetables 

-  have  an  automated  master  schedule  builder 

-  have  a  manual  master  schedule  builder 

-  allow  automated  entry  of  course  requests 

-  allow  manual  entry  of  course  requests 

provide  adequate  checking  of  pre-  and  co-requisites 

-  allow  for  student  preferences 

-  produce  appropriate  pre-  and  post-scheduling  reports 
complete  one  scheduling  simulation  run  within  24  hours  for  as 
many  as  2300  students 

-  be  able  to  produce  necessary  scheduling  reports  without 
interfering  or  delaying  the  computer  utilization  for  other  system 
functions 

For  junior  high  schools  only,  the  system  should: 

-  allow  homeroom  grouping  for  core  subjects 

be  capable  of  scheduling  any  course  in  any  combination  of 
periods 
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The  Attendance  Function 


The  system  should: 

-  allow  automated  entry  of  attendance  data 

-  allow  manual  entry  of  attendance  data 

-  allow  multiple  user-defined  absence  types 

-  be  able  to  record  detailed  attendance  information  at  various 
intervals 

-  maintain  detailed  attendance  data  for  at  least  ten  days 

-  maintain  cummulative  attendance  history  for  one  school  year 

-  be  able  to  produce  various  user-defined  reports  based  on  the 
available  data 

The  Student  Marks  Function 

The  system  should: 

-  allow  automated  entry  of  marks  information 

-  allow  manual  entry  of  marks  information 

allow  a  minimum  of  A  term  marks  and  a  final  mark 

-  be  able  to  produce  report  cards  using  a  user-defined  format 

-  produce  various  user-defined  reports 

General  Functionality 

The  system  should: 

-  perform  all  runs  within  the  time  frame  dictated  by  the 
instructional  support  processes  adopted  in  the  school 

-  accommodate  all  data  required  by  the  available  processes  within 
the  limitations  of  currently  available  hardware  configurations 

-  have  a  built  in  back-up  and  recovery  procedure,  or  provide  clear 
instructions  on  the  file  structure  for  backup  and  recovery 
through  the  operating  system  utilities 

-  provide  at  least  password  security  protection  to  prevent  access 
to  the  data  by  unauthorized  users 
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4.3    Selection  Criteria  -  Level  3 


This  is  the  final  and  most  critical  level  of  the  evaluation.     Evaluation  at 
this  level  implies  functional  and  performance  testing  and  evaluation  of  all 
system  modules  at  the  detailed  level  in  a  real  life  environment.     The  concept 
of  weighting  is  introduced  at  this  level  of  the  evaluation.     Besides  product 
quality,  functionality,  and  reliability  considerations,  this  level  also 
implies  vendor  evaluation  in  terms  of  expertise,  product  plans ,  and  support 
services  (e.g.  installation,  training,  maintenance,  consulting).    This  stage 
is  time  and  resource  intensive  and  thus  should  only  be  undertaken  on  a  short 
list  of  high  potential  systems  alternatives.     Evaluation  at  Level  3  is, 
itself,  a  two  phase  process.     First,  each  system  alternative  is  evaluated 
against  the  most  detailed  criteria,  and  secondly,  the  outcomes  of  individual 
product  evaluations  are  summarized  and  compiled  for  comparison  purposes  to 
facilitate  final  selection.     To  facilitate  this  stage  of  evaluation,  two 
separate  documents  have  been  developed.     The  first  is  the  SIMS  Selection 
Criteria  Level  3  Working  Form,  which  is  described  and  the  document  shown  in 
section  3.3.1.     The  second  document  is  the  Comparison  Summary  and  Review  Form 
which  is  described  and  shown  in  section  3.3.2. 

4.3.1    Selection  Criteria  Level  3  -  Working  Form 

This  document  provides  the  greatest  level  of  detail  of  all  and  is  intended  for 
use  during  the  detailed  and  comprehensive  testing  of  each  individual 
product.     The  left  hand  side  of  the  document  identifies  major  evaluation 
factors.     Inmiediately  to  the  right  of  this  is  a  column  entitled  CRITERIA 
ITEMS.     For  each  major  evaluation  factor,  this  particular  column  contains  a 
number  of  major  criteria  (e.g.  features,  processes,  or  attributes  of  a  system) 
which  are  to  be  quantitatively  evaluated.     These  major  criteria  are  identified 
by  underlining.     Below  each  major  criteria  is  a  list  of  detailed  criteria. 
The  detailed  criteria  are  of  two  types  -  those  which  will  be  scored  during  the 
evaluation  and  those  which  are  provided  for  context  consideration  only  and 
which  will  not  be  scored.     Criteria  items  provided  for  context  consideration 
are  preceded  by  a  hyphen  (-).     Criteria  items  which  will  be  scored  can  be 
identified  by  the  presence  of  an  entry  in  the  column  marked  WEIGHT. 

By  way  of  example,  the  key  function  entitled  School  Records  (associated  with 
the  Product  Scope  and  Function  evaluation  factor)  has  been  broken  down  into 
three  major  criteria,  namely  (1)  Pre-Registration/  Enrollment,  (2)  Detailed 
Data  Items  and  (3)  Reports/Inquiries.     For  Pre-Registration  and  Enrollment, 
three  detailed  criteria  have  been  identified  which  should  be  scored  -  notably. 
Create  student  record.  Registration  confirmation  notice,  and  Feeder  school 
confirmation  notice. 

To  assist  with  the  development  of  a  score  for  the  Create  student  record 
criteria  item,  general  non-scorable  context  or  supplementary  items  have  been 
listed  for  consideration  such  as  school  student  ID,  last  name,  etc.     By  way  of 
contrast,  no  context  or  supplementary  items  were  considered  necessary  in 
relation  to  the  scorable  Registration  confirmation  notice  item. 
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The  column  entries  for  the  Level  3  working  form  document  are  summarized  below. 


Evaluation  Factor  -  identifies  a  key  area  of  evaluation  and 

the  beginning  of  a  detailed  criteria  list 
for  that  particular  factor. 


Criteria  Itea  -  identifies  a  feature,  process  or  attribute 

associated  with  the  factor.     The  Criteria 
item  column  also  contains  supplementary 
entries  intended  to  provide  an  evaluator 
with  a  more  complete  perspective  on  a 
particular  criteria  item  being 
evaluated.     Supplementary  entries,  which 
are  identified  by  a  preceding  hyphen,  do 
not  have  a  weight  assigned  to  them. 

Height  -  is  a  measure  of  the  relative  importance  of 

a  criteria  item  to  the  user.     Summing  of 
weighting  factors  (or  weights)  gives  a 
broad  perspective  of  the  relative 
importance  of  major  areas  or  modules 
within  the  context  of  the  entire 
evaluation.    Weights  are  assignable  at  the 
discretion  of  the  user. 


Score  -  is  a  measure  of  how  well  a  given  criteria 

is  met  by  a  particular  alternative.     It  is 
suggested  that  scores  be  assigned  on  a 
simple  0-10  scale  (or  user  defined 
equivalent).     Only  those  items  which  have 
weighting  factors  should  be  scored. 
Levels  1  and  2  of  the  evaluation  are 
checklist  oriented  and  thus  scoring  is  not 
required. 


Weighted  Score  -  this  column  entry  is  the  product  of  the 

weight  and  the  raw  score  and  is  a  measure 
of  how  well  the  needs  of  a  user  are  met  on 
that  particular  item,  area  or  module. 


Maxisua  Weighted  Score  -  is  the  product  of  the  weight  and  the 

maximum  possible  score.     This  would  be  the 
weighted  score  which  implies  a  perfect  fit 
to  the  needs  of  the  user  on  a  particular 
criteria  item,  set  thereof,  factor,  etc. 

Weighted  Score/Max  Weighted  Score  ~  this  ratio  gives  a  proportional  measure  of 

how  well  user  needs  are  met  on  a  particu- 
lar item,  set  thereof,  factor,  etc. 
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Wr  SCORE/MAX  WT  SCORE 

MAX  WT  SCORE 

w 
X! 

WEIGHTED  SCORE 

(W  X  S) 

SCORE  t 

/-^ 
CO 

WEIGHT 
(W) 

m 

CRITERIA  ITEMS 

Reports/Inquiries 

All  reports  and  inquiries  should  be  avail- 
able for  all  or  a  specified  range  of 
records,  in  various  sort  orders. 

-  class  lists 

-  homeroom  lists 

-  student  name  labels 

-  student  address  labels 

-  parent  address  labels 

-  student  I.D.  cards 

-  student  data  (alphabetical  or  numerical 
order) 

-  parent  data  (alphabetical  or  numerical 
order) 

-  instructor  data  (alphabetical  or  nniw^r- 
ical  order) 

-  course  data 

-  student  phone  list 

-  student  name  list 

-  student  grade  list 

-  feeder  school  list 
locker  information  list 

-  student  population  by  instruction  type 

-  fee  sheets 

The  system  should  allow  production  of 
user-defined  reports/inquiries  using 
available  data. 

TOTAL  Reports/ Inquiries 

TOTAL  SCBOOL  REOOKDS 

1  EVALUATION 

FACTOR 
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CRITERIA  ITEMS 

-  hardware 

-  system  software  environment 

-  operating  system 

-  utilities 

-  database  management/ system 
internals/files 

-  networking  capabilities 

-  user  hooks 

-  modularity  of  the  system 

GRAND  TOTAL,  TECHNICAL  CONSIDERATIONS 

-  local  versus  where/how  far 

-  package  support  and  services 
-  software  support,  custom 

modifications 

-  documentation 

-  user  guide,  application  system, 
procedural,  operations  guide, 
file  layouts 

-  training 

-  applications  system,  operational 
(DP),  availability  schedule,  format, 
location,  prerequisites 

-  implementation 

-  training 

-  initialization  (conversion, file  set- 
up, output  forms) 

-  implementation  plan 

GRAND  TOTAL »  SUPPORT  &  SERVICES 

§ 

M 

1 

1 

CONSIDERATIONS 
SOPPCKT  & 
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EVALUATION                              CRITERIA  ITEMS 
FACTOR 

PRODUCT 
QUALIFICATIONS 

-  package  background 

-  reliability 

-  current  development  status 

-  number  of  installations 

-  product  development  plans 

-  release  concept,  portability, 
verticality 

GRAND  TOTAL,  PRODUCT  QUALIFICATIONS 

-  Corporate  information 

-  background  and  history 

-  financial  performance 

-  employee  base 

-  Market  volatility  and  vendor  stability 

-  References 
Contractual  Terms 

-  maintenance 

-  warranty 

-  ownership  rights 

-  discount  structure/price  limit 

GRAND  TOTAL.  VENDOR 
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A,3.2    Selection  Criteria  Level  3  -  Comparison  Summary  and  Review  Form 


The  Level  3  working  form  Is  used  exclusively  for  one  product.     In  contrast » 
the  Comparison  Summary  and  Review  Form  contains  a  summary  of  the  results  of 
the  detailed  evaluations  on  all  (three  In  our  example)  products  under 
consideration.    This  form  Is  designed  to  facilitate  comparison  between 
alternatives  based  on  the  six  major  factors  referred  to  In  section  2.0  (and 
which  were  evaluated  In  detail  through  the  Level  3  Working  Form). 

To  employ  the  comparison  summary  and  review  form,  the  potential  SIMS  user 
completes  the  column  marked  EMPHASIS.     Entries  in  this  column  indicate  the 
relative  emphasis  which  a  user  places  on  the  corresponding  evaluation 
factor.    The  potential  user  then  extracts  the  ratio  (weighted  score/max 
weighted  score)  from  the  Level  3  Working  Form  for  each  of  the  evaluation 
factors,  multiplies  this  ratio  by  the  EMPHASIS  and  enters  the  result  in  the 
appropriate  column  for  each  product  alternative  under  consideration. 
Resulting  entries  in  the  product  columns  will  be  numbers  (less  than  or  equal 
to  the  corresponding  emphasis)  which  are  measures  of  the  suitability  of  the 
particular  product  for  a  given  evaluation  factor.    These  numbers  can  be 
considered  to  be  scores  out  of  the  percent  emphasis.    The  vertical  total  of 
suitability  will  be  a  score  out  of  100  for  a  given  product  which  can  be  easily 
compared  from  product  to  product. 

It  should  be  noted  that  suitabilities  calculated  according  to  the  method 
described  should  be  viewed  as  relative  measures  of  the  extent  to  which  systems 
meet  a  patlcular  user's  needs.     Suitabilities  will  vary  according  to  the 
completeness  of  the  criteria,  user  defined  weighting  factors,  percent  emphasis 
and,  very  obviously,  on  the  scores  assigned  by  the  product  evaluator. 

It  should  be  noted  that  the  user  may  easily  define  and  use  versions  of  this 
form  at  a  more  detailed  level  if  so  desired. 

For  those  evaulators  who  may  wish  to  compare  natural  and  weighted  scores 
across  product  alternatives,  a  Detailed  Scoring  Comparison  Form  is  included 
(see  Appendix  3).    This  particular  form  is  identical  in  format  to  the  Level  3 
Working  Form  and  contains  only  those  items  which  were  scorable  (i.e.  it  does 
not  include  context  related  items). 


(25) 


SIMS  -  SELECTION  CRITERIA  -  LEVEL  3  -  Comparison  Summary  and  Review  Form 


EVALUATION  FACTOR 

EMPHASIS 

K/o) 

SUITABILITY  =  EMPHASIS  X  (     WEIGHTED  SCORE  ) 

(MAX  WEIGHTED  SCORE) 

PRODUCT  1 

PRODUCT  2 

PRODUCT  3 

PRODUCT  SCOPE  AND  FUNCTION 
EASE  OF  USE  (OF  PRODUCT) 
TECHNICAL  CONSIDERATIONS 
SUPPORT  AND  SERVICES 
PRODUCT  QUALIFICATIONS 
VENDOR 

TOTALS 

100 
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5.0    SUGGESTED  USE  OF  THE  SELECTION  CRITERIA 


Level  1  and  Level  2  criteria  documents  have  been  designed  for  use  in  simple 

checklist  fashion,  and  are  intended  to  facilitate  product  screening.     The  user 

should  determine  how  well  a  product  alternative  meets  the  criteria  set  out  and 

whether  to  proceed  to  successive  levels  of  the  evaluation  process. 

Level  3  of  the  evaluation  process,  though  very  detailed,  is  also  flexible. 
The  following  steps  are  suggested  for  the  Level  3  evaluation: 

o  examine  the  criteria  for  completeness  -  add  needed  items 
o  confirm/adjust  the  weighting  system 
o  choose  a  comfortable  scoring  scale 

o  prepare  one  adjusted  Level  3  Working  Form  for  each  product  to  be 
evaluated 

o  score  relevant  criteria  items  for  each  product  according  to  scoring 
scale 

o  calculate  weighted  scores,  maximum  weighted  scores  and  the  ratios  of 
weighted  scores  to  maximum  possible  weighted  scores  for  each  product 
evaluated 

o  calculate  subtotals  and  totals' 

o  transfer  raw  and  weighted  score  to  the  Detailed  Scoring  Comparison  Form 
(optional) 

o  define  the  percentage  emphasis,  extract  data  from  the  Level  3  Working 
Form  and  complete  the  Comparison  Summary  and  Review  Form 

o  analyze  the  Comparison  Summary  and  Review  Form  to  determine  the  most 
suitable  product  -  this  will  be  indicated  by  the  product  with  the 
highest  total  suitability 

Both  weighting  factors  and  scoring  scales  are  user  definable.     It  is 
important,  however,  to  evaluate  competitive  products  on  the  same  set  of 
criteria. 

Having  determined  the  relative  suitability  of  competitive  products,  product 
price  must  be  considered  as  a  factor  for  a  second  time.    Having  evaluated  a 
product  at  Level  3  itself  implies  that  it  is  within  the  realm  of  affordabil- 
ity.    The  decision  which  must  now  be  made  relates  to  differences  and  tradeoffs 
between  product  suitability  and  product  price. 
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6.0    COMMENTS  AND  CONCLUSIONS 


A  flexible  process,  together  with  supporting  documentation,  has  been  developed 
which  is  adaptable  and  which  can  be  universally  applied  to  the  evaluation  of 
School  Information  Management  Systems  (SIMS).     The  process  is  simple  to  apply 
and  may  be  used  by  district  or  school  administrators  to  evaluate  systems 
alternatives,  independent  of  the  level  of  hardware  to  be  employed  (i.e. 
microcomputer,  minicomputer  or  mainframe). 

In  fact,  the  detailed  evaluation  of  a  product  (Level  3  Working  Form)  could  be 
carried  out  objectively  by  a  technical  expert,  the  outcomes  of  which  can  be 
effectively  employed  in  a  subjective  way  by  the  potential  user  to  determine 
its  suitablity  to  his/her  particular  needs. 

The  choice  of  a  SIMS  has  far  more  profound  implications  beyond  the  cost  of  the 
system  itself,  for  reasons  which  have  already  been  mentioned.  Accordingly, 
this  initial  step  towards  the  computerization  of  school  information  management 
processes  should  receive  careful  consideration. 

In  view  of  the  current,  extremely  high  level  of  interest  in  this  area,  and  of 
the  significant  implications  of  related  decisions,  we  recommend  that  the 
process  and  documentation  be  communicated  to  other  districts  as  soon  as 
possible.    The  critical  level  of  interest  has  been  emphasized  by  frequent  and 
detailed  communications  on  this  topic  with  other  schools. 

It  should  be  emphasized  that  the  Level  3  evaluation  of  SIMS  is  a  time 
consuming  and  intensive  process.     In  view  of  this,  it  is  not  likely  that  an 
individual  school  or  a  small  jurisdiction  will  undertake  the  evaluation  of 
more  than  one  system  at  the  same  time.     This  means  comparative  results  will 
not  be  available  with  which  to  determine  the  relative  benefits  and  trade-offs 
between  alternatives.     In  such  cases,  it  is  highly  likely  that  the  first 
alternative  evaluated  will  be  adopted  operationally  unless  it  turns  out  to  be 
quite  unacceptable. 

Sequential  and  potentially  limited  evaluation  of  system  alternatives  implies 
that  detailed  information  on  systems  alternatives  will  not  be  simultaneously 
available  to  schools  at  the  point  in  time  when  critical  long  term  operational 
decisions  are  being  made.     In  order  to  maximally  benefit  schools  throughout 
the  Province,  evaluations  should  proceed  in  parallel.     Such  parallel 
investigation  is  currently  taking  place  through  a  separate  project  funded 
jointly  by  Alberta  Education  and  Edmonton  Public  Schools.     In  addition  to  the 
information  being  acquired  through  this  investigation,  we  recommend  that 
Alberta  Education  encourage  the  completion  of  the  Level  3  documents  by  those 
schools  or  districts  who  may  be  currently  engaged  in  detailed  evaluations  of 
SIMS.    This  information  should  then  be  collected,  analyzed  and  appropriately 
communicated.     Although  it  is  highly  desirable  to  have  scoring  judgments  made 
as  consistently  as  possible  in  order  to  maintain  reasonable  comparability  (as 
is  the  case  within  the  Edmonton  Public  Schools  initiatives),  all  input  and 
experience  is  of  value  and  should  be  sought  out  and  compiled. 

It  is  the  intention  of  the  Distributed  Systems  Team  to  utilize  the  criteria  as 
a  common  basis  to  report  the  outcome  of  all  of  its  micro  and  mini  based  SIMS 
related  project  commitments  to  Alberta  Education. 
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APPENDIX  1 


GENERAL  QUESTIONNAIRE 


This  document  was  distributed  to  schools  for  completion 
as  an  Initial  Information  gathering  step  In  the  process 
to  develop  evaluation  and  selection  criteria  for  school 
Information  management  systems. 


EDMONTON  PUBLIC  SCHOOLS 
COMPUTERIZATION  OF  SCHOOL  ADMINISTRATIVE/INFORMATION  SYSTEMS 

GENERAL  QUESTIONNAIRE 


Background 


The  Distributed  Systems  Services  Team  has  identified  a  short  list  of  compu- 
ter software  packages  specifically  designed  for  the  day-to-day  student 
administrative  requirements  of  individual  schools.    In  order  to  facilitate 
the  selection  of  the  most  suitable  software  alternative,  for  the  EPSD  from 
a  District-wide  perspective,  the  attached  questionnaire  has  been  prepared 
with  a  view  of  determining  the  relative  importance  of  the  type  of  inform- 
ation, system  functions  and  features  needed  by  the  school (s).    In  addition, 
personal  interviews  will  be  conducted  with  each  participating  school  in 
order  to  determine  each  school's  specific  information  requirements,  review 
the  type  and  detail  of  data  needed  by  the  school  to  streamline  its  oper- 
ations and  identify  any  areas  of  concern. 


The  questionnaire  has  been  divided  into  two  parts.  Part  1  deals  with  the 
information  needs  of  a  STUDENT  ADMINISTRATIVE  SYSTEM  and  Part  2  addresses 
other  information  requirements  that  the  school (s)  may  have. 


Part  1  -  STUDENT  ADMINISTRATIVE  SYSTEM 


Each  item  is  to  be  weighted  in  accordance  to  its  relative  importance  to  the 
specific  institution  completinq  the  questionnaire,  using  the  following  rat- 
ing scale. 


NONE  -  Not  required. 


OPT 


IMP 


Optional 


Should" 

"Desireable" 

"Important") 


MUST  -  Mandatory 


a  requirement  not  considered  essential  but 
for  which  preference  may  be  given 

a  requirement  having  a  significant  degree 
of  importance  to  the  objectives  of  the 
Student  Administrative/Information  System 

a  requirement  that  must  be  met  in  a  sub- 
stantially unaltered  form  in  order  for  the 
software  package  to  meet  the  schools  vital 
information  needs. 


Part  2  -  OTHER  INFORMATION  SYSTEMS 


Applications  should  be  ranked  in  accordance  with  the  school's  priority  to 
computerize  other  areas  of  its  operations. 
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NAME  OF  SCHOOL  (in  full) 


Questionnaire  completed  by:  (Name) 


(Title) 


PART  1 


STUDENT  ADMINISTRATION  SYSTEM  -  INFORMATION  NEEDS 


SECTION  A  -     School  records,  student  records,  attendance  recording/ 
reporting,  student  marking  process  and  reporting 
requirements. 


General  Overview  of  the  System's  Objectives 


A  computerized  student  administrative  system  to  resolve  and  streamline  the  collecting, 
transcribing,  maintaining  and  reporting  of  student  data.    It  is  to  maintain  student  relat- 
ed data,  provide  up-to-date  information  and  prepare  reports  that  are  used  by  administra- 
jtors,  counsellors,  instructors,  students  and  parents. 


Information  Need  -  Relative  Rating  Scale  Legend: 


Relative  Importance 


Column  Heading 


NONE 


OPT 


IMP 


MUST 


Degree  of  importance 


Not  required 


Optional 


Important 


Mandatory 
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Appi ication/Feature  Description   Relative  Importance  

NONE  OPT  IMP  MUST 

1)  Registration/Enrollment 

-Entering  a  student  into  the  school  and 

creating  the  student  record         

-Registration/Enrollment  confirmation  notice         

-Other  information  needs  (specify): 


2)    Student  Records 

-Demographic  data  e.g.  name  and  address,  pro- 
gram, type  of  instruction,  medical,  class(es), 
timetable,  medical,  parents,  etc. 

-History  i.e.  academic  achievements,  marks, 
course  attempts,  etc. 

-Student  coding  e.g. 

-  school  ID# 

-  EPSD  &  Alerta  student  ID  # 

-Bus  Information  e.g.  bus  pass  number,  pick- 
up and  drop  off  points,  driver  name,  bus 
routes  etc. 

-Interface/integration  with  your  school's 
accounting  system  (in  future) 

-Other  (specify) 
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Application/Feature  Description   Relative  Importance  

NONE  OPT  IMP  MUST 

3)    Student  Attendance  

-Indicate  the  frequency  that  attendance  is/ 
should  be  taken  in  your  school  e.g.  every 
period  (by  class)  once  per  day,  twice  per 
day,  at  homeroom  time,  etc. 


-How  often  do  you  need  attendance  reports 
e.g.  daily,  weekly,  bi-weekly,  etc.? 


-How  much  detailed  attendance  history  does 
your  school  require  to  keep  "on-line"  for 
parent,  counsellor  inquiries  e.g.  5  days 
history,  6  days  history  etc.? 


•What  types  of  attendance  reports  do  you  need? 
e.g.  by  student,  student  by  class/subject, 
student  by  day,  exception  reports  etc.  and 
how  frequently  do  you  require  each  report? 


4)    School  Reports 

-Directories/class  lists 
j     -Labels  (mailing) 
I     -Student  ID  cards 
I     -Schedules  (student,  teachers,  rooms) 
I     -Other  reports  (specify) 
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Appi ication/Feature  Description   Relative  Importance 

NONE  OPT  IMP 


5)    Instructor  Records 

-Personal  and  demographic  information 
-Courses  taught 
-Areas  of  specialty 
-Certificate  number 
-Other  (specify) 


6)    Student  Marking  Process 

-Comprehensive  editing  and  validation  of  student 
marks  prior  to  report  card  preparation  e.g.  mark 
verification,  identification  of  student  with 
unassigned  marks  etc. 

-Report  card  printing  [ 
-Type  of  reports  e.g.  CPA's,  honour  lists,  etc. 
(Please  specify): 


-Other  information  needs  (specify): 


-What  is  the  maximum  number  of  marks  per  course 
maintained  by  your  school  for  a  student  e.g. 
4  mid-term  marks,  2  exams  and  a  final  mark? 
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Appi ication/Feature  Description 


Relative  Importance 


NONE 


OPT 


IMP 


MUST 


7)    Student  Exams 


-Exam  timetable  builder 
-Exam  conflicts  matrix 
-Exam  schedules 
-Other  (specify) 


8)  Courses 


■Course  number,  short  description,  detailed 
description  (for  annual  school  handbook), 
credit  values,  prerequisites,  etc. 
•Other  information  requirements  (specify): 
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SECTION  B    -    STUDENT  SCHEDULING 


Course  requests,  prerequisite  verfication,  request  confirmation,  student  curricular  coun- 
selling, computerized  scheduling,  school  start  up  registration,  automatic  generation  of 
student  fee  sheets  and  printing  of  individual  timetables. 


THIS  SECTION  IS  APPLICABLE  TO  HIGH  SCHOOLS, 
JUNIOR  HIGH  SCHOOLS  AND  ELEMENTARY-JUNIOR 
HIGH  SCHOOLS  ONLY 
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SECTION  B    -    STUDENT  SCHEDULING 


Course  requests,  prerequisite  verification,  request  confirmation,  student  curricular 
counselling,  computerized  scheduling,  school  start  up  registration,  automatic  generation 
of  student  fee  sheets  and  printinq  of  individual  timetables. 


Appl ication/Feature  Description   Relative  Importance  

NONE  OPT  IMP  MUST 

1)  Pre-scheduling 

-Comprehensive  editing  and  validation  of 
course  requests  e.g.  prerequisite  checkinq 
marks  verification,  identification  of 
students  with  no  requests,  insufficient/ 

excessive  credits  requested         

-Preschedul inq  reports  e.g.  course  tally 
list,  exception  reports  (students  missing 

mandatory/compulsory  courses)         

-Scheduling  conflicts  matrix        

-Other  information  needs  (specify): 


-Other  preschedul  ing  reports  (specify): 


2)    Master  Schedule 

-Master  timetable  builder 

i)    What  course  code  would  you  prefer  to 
use  e.g.  a  school  course  code,  EPSD 
course  code  or  the  Alberta  course  code 


ii)  Please  specify  ALL  of  the  scheduling 

units  used  by  your  school,  e.g.  semester 
full  year,  trisemester,  six  week  section, 
quartermester,  etc. 
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Application/Feature  Description   Relative  Importance 


NONE  OPT  IMP  MUST 

iii)  Please  specify  the  following: 

Rotation:  

Days  per  week:   

Periods  per  week:   

used  in  your  school's  master  timetable. 


3)    Student  Scheduling 

-Completion  of  the  student  scheduling  process 
before  the  summer  break 

-Ability  to  preassign  sections  [ 
-Ability  for  your  school  to  assign  scheduling 
priorities 

-Automatic  scheduling  of  an  individual  student 

i.e.  mid-term  transfer  pupil 
-Ability  to  schedule  groups  of  students 

i.e.  unregistered  last  minute  arrivals 
-Ability  to  'UNSCHEDULE"  a  student  or  group 

of  students  i.e.  no  shows,  students  that 

move  away  during  summer  etc. 
-Restart  capabilities  e.g.  reset  assignments 

for  a  student  and/or  course 
-Course  sequencing 

-Course  weighting  i.e.  ability  of  the  computer- 
ized scheduler  to  distribute  course  loads  evenly 
so  that  a  student  is  not  scheduled  to  take  an 
overload  of  difficult  courses  in  the  first 
semester  and  a  group  of  relatively  easier 
courses  during  the  second  semester 

-Blocking  ] 

-Class  balancing  " 

-Semester  balancing 

-Double  room  identity  e.g.  Physical  Education 
all  male/female  class 

-Double  room  identity  for  mixed  classes  e.g. 
Home  Economics  and  Industrial  Arts 


i)    What  are  your  present  scheduling  priorities 
e.g.  -  lower  grade  students  first  and  so 
on  up  to  highest  grade? 


e.g.  -  single  section  courses  before 
multiple  section  courses? 


-  CONTINUED  ON  NEXT  PAGE  - 
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Application/Feature  Description   Relative  Importance  

NONE  OPT  IMP  MUST 

e.g.  -  mandatory/compulsory  courses  first 
followed  by  student  preferences 
followed  by  options/alternatives? 


OR  indicate  your  priorities  in  the  space 
below: 


-Ability  to  run  schedules  from  more  than  one 
perspective  e.g.  single  sections  first  then 
mandatory  courses  etc.  and  mandatory  courses 
first  and  single  sections  last 

-Other  information  needs  (specify): 


Reports 

-Student  schedules 
-Multiple  conflicts  matrix 
-Partially  scheduled  students 
-Other  (specify): 


4)    School  Start  Up 

-Generation  of  fee  sheets 

-Ability  to  schedule  all  new  students  (unexpect- 
ed enrollments)  only  i.e.  the  schedules  for  all 
previously  registered  students  would  not  be 
affected 

-Preparation  of  timetables  in  grid  format 

(students,  teachers  and  rooms) 
-Class  lists 
-Other  (specify): 
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THE  FOLLOWING  ITEMS  ARE  PERCEIVED  TO  BE  APPLICABLE 
TO  SCHEDULING  IN  JUNIOR  HIGH  SCHOOLS  ONLY 


Appi ication/Feature  Description   Relative  Importance  

NONE  OPT  IMP  MUST 

5)    Special  Scheduling  Requirements 
of  Junior  Hiqh  Schools 

-Blocking  of  course  options 
OR 

Scheduling  students  requesting  same  group  of 

options  into  the  same  class  or  homeroom    


-Blocking  of  2-3  sections  of  the  same  course 
in  same  time  block  e.g.  Math  or  Language  Arts 

-Homeroom  identity  grouping  for  Language  Arts, 
Social  Studies,  Science,  Math 


-Ability  to  handle  option  courses  with  varying 
lengths  of  instruction  e.g.  French  as  an  option 
requires  four  periods  per  week  whereas  other 
options  require  three  periods  per  week 


-Back  to  back  time  tabling  for  double  classes 


-Ability  to  handle  variable  time  slots  by 
course  subject  e.g.  six  periods  of  Language 
Arts,  five  periods  of  Math,  four  periods  of 
Social  Studies,  etc. 


-Other  requirements  or  unique  characteristics 
associated  with  the  scheduling  process  for 
your  school 


Please  specify  any  idiosyncracies  in  your 
schools  allocation  of  subject  time  e.g. 
different/variable  periods  (standard  period 
=  40  minutes,  course  x  has  a  period  of 
30  mi  nutes,  etc . ) 
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PART  2  -  OTHER  INFORMATION  SYSTEMS 

Please  rank  the  importance  of  each  application  in  accordance  with  your 
schools  priority  to  computerize  other  areas  of  its  operations,  e.g.  1,  2,  3 
etc.,  from  most  important  to  least  important.    If  an  application  is  not 
perceived  to  be  a  requirement  indicate  a  priority  of  "0"  (zero)  or  "NIL". 

Implementation 

Application/System  or  Sub-system  Priority  

Accounts  Payable   

Accounts  Receivable   

Budgeting   

Computer  Assisted  Instruction  (CAI,  CAL,  CML)   

Cost  Accounting   

Financial  (General  Ledger  and  Financial  Statements)  

-  also  indicate  whether  or  not  you  require 
commitments  to  be  included  i.e.  encumberance 

accounting  Yes  or  No     

Fixed  Assets   

Inventory  Control   

Library  Services   

Purchasing   

Word  Processing   

Work  Orders   

Other  (Specify)   
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APPENDIX  2 
INTERVIEW  GUIDE  AND  DETAILED  CHECKLIST 


This  document  was  used  to  facilitate  a  follow-up 
interview  with  surveyed  schools  to  clarify  and  confi 
their  responses  to  the  general  questionnaire. 


EDMONTON  PUBLIC  SCHOOLS 


COMPUTERIZED  INFORMATION  SYSTEMS  NEEDS  OF  INDIVIDUAL  SCHOOLS 


INTERVIEW  GUIDE  AND  DETAILED  CHECKLIST 


SECTION  A  -     School  records,  student  records,  attendance  recording/ 
reporting,  student  marking  process  and  reporting 
requirements. 


Appi ication/Feature  Description   Relative  Importance 


NONE  OPT  mP_  MUST 

1)  Registration/Enrollment 

Use  questionnaire. 


2)    Student  Records 

-Personal /Demographic 

-Courtesy  name 

-Academic 

-Activities 

-Medical 

-Program 

-Type  of  instruction 
-Timetables 
-Courses  and  classes 

-Student  history  to  include  all  courses/marks 
while  in  the  school 
OR 

Does  the  school  want  to  include  all  marks  the 
student  has  achieved  while  in  a  similar  level 
of  school  e.g.  High  School,  Grades  10-12; 
Junior  High,  Grades  7-9  etc. 
Specify  level  of  detail  needed  below: 


-Complete  history  of  each  course  that  each 
student  attempts,  including  the  number  of 
attempts 


-Parent  data  up  to  a  maximum  of  2  parents 
per  student 
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Application/Feature  Description   Relative  Importance 


NONE  OPT  IMP  MUST 

-Is  a  limit  of  2  parents  sufficient? 
Yes  or  No 


-Bus  pass  number 
-Bus  route(s) 
-Driver  name 

-Pick-up  and  drop  off  points 

-Student  ID  #  (indicate  whether  the  school 

has  a  preference  for  its  own  unique  ID 

system  or  the  EPSD  ID  #) 


-Multiple  ID'S  for  cross  referencing  and 
interface  with  EPSD  and  Alberta 


3)    Student  Attendance 

Use  questionnaire. 


4)    School  Reports 

Use  questionnaire. 


5)    Instructor  Records 

Use  questionnaire. 


6)    Student  Marking  Process 

-Report  cards  prepared  by  school  rather 

than  ISB  Yes  or  No   

If  Yes  indicate  level  of  importance 


-Student  marks  proof  listing  for  verification 
before  production  of  report  cards 


-Student  transcripts 


7)    Student  Exams 

Use  questionnaire. 
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Appi i cation/Feature  Description   Relative  Importance 


NONE  OPT  mP_  MUST 

8)  Courses 

-Term  weight         

-Included/excluded  from  report  card  average         

-Pass/Fail  mark         

-Other  (specify): 


SECTION  B  -  STUDENT  SCHEDULING 


N.B.    THIS  SECTION  SHOULD  BE  COMPLETED  FOR  HIGH  SCHOOLS  AND  JUNIOR 
HIGH  SCHOOLS  ONLY 


Application/Feature  Description   Relative  Importance 

1)  Pre-scheduling 

-Student  course/proqram/curricul urn  counselling 
list 


-Marks  verification  as  part  of  prerequisite 
checking  e.g.  49%  in  Math  10  is  not  acceptable 
for  entry  into  Math  20  course  but  is  acceptable 
for  Math  23 

In  this  case  should  the  student  be  advised 
of  his/her  options  before  the  scheduling 
simulation  i.e.  repeat  Math  10  or  opt  for 
Math  23?    Yes  or  No    ? 


-Ability  for  the  individual  student  to 
identify  his/her 

a)  mandatory/compulsory  courses 

b)  preferred  course  requests 

c)  preferred  alternatives 


CONTINUED 
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Appi ication/Feature  Description   Relative  Importance 


NONE  OPT  IMP  MUST 

-Ability  to  conduct  prerequisite  checking  for 
students  from  another  school  within  the  EPSD 


-Ability  to  handle  co-requisites 


-Ability  to  add  student  records  from  another 
EPSD  school  into  your  microcomputer  e.g. 
transfer  student,  graduate  student  from 
a  feeder  school  etc. 


2)    Master  Schedule 

-Current  Semester 
-Current  Year 
-Future  Semester(s) 
-Other  (specify): 


3)    Student  Scheduling 

-Access  to  scheduling  alorithim  e.g.  logic, 
parameters,  scheduling  resolutions,  options  etc. 


-"Teacher  Link  Courses"  e.g.  in  the  instance 
where  a  teacher  is  instructing  English  10 
and  Social  10,  a  common  core  of  students 
should  be  scheduled  to  this  teacher  for 
both  courses  (subjects) 


-Arena  scheduling 

-Student  section  selection  (preference) 
-Student  instructor  selection  (preference) 
-Reduced  term  requests  i.e.  scheduling  a 
student  into,  say,  the  second  semester  of  a 
full  year  English  course  in  order  to  improve 
his/her  grade  without  repeating  the  first 
semester  which  he/she  passed  satisfactorily 


-Specific  term  requests  e.g.  Biology  10  in 
first  semester  and  Biology  20  in  the  second 
semester 


CONTINUED 
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Application/Feature  Description   Relative  Importance 


NONE  OPT  IMP  MUST 

-Other  requirements  for  an  in-house  computer- 
ized scheduler: 

-  use  data  from  questionnaire  and  interview 

4)    School  Start  Up 

Use  questionnaire. 


5)    Special  Scheduling  Requirements 
of  Junior  High  Schools 

Use  questionnaire. 

ENSURE  THAT  THE  JUNIOR  HIGH  SCHOOL  IDENTIFIES 
ITS  UNIQUE  NEEDS  AND  DEFINES  ANY  ITEMS  OR 
AREAS  THAT  DIFFER  FROM  THE  NORM. 
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PART  2  -  OTHER  INFORMATION  SYSTEMS 


ACCOUNTS  PAYABLE  (A/P) 


1)    Open  item  or  balance  forward 


2)    Does  the  school  issue  its  own  A/P  cheques? 


If  Yes  how  many  cheques  does  it  issue  per  month  on  the  average? 


3)    What  is  the  average  number  of  General  Ledger  distributions  per  vendor  invoice? 


4)    If  the  school  has  indicated  that  the  computerization  of  its  Accounts  Payable  applica 
tion  is  a  need,  obtain  a  general  description  of  what  the  school  expects  from  an  auto 
mated  system  e.g.  type  of  reports,  statistical  analysis,  breakdown  of  A/P  expenses 
(how?)  etc. 


5)    Should  the  school's  purchase  orders  be  included  in  the  A/P  system  to  reflect  commit- 
ments? 
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ACCOUNTS  RECEIVABLE  (A/R) 

j  1)    Open  item  or  balance  forward 

I 
1 
I 

2)  How  many  invoices  does  the  school  issue  per  month? 

i 

3)  Does  the  school  issue  monthly  statements  for  unpaid  accounts? 


4)    Why  does  the  school  want  to  automate  its  A/R  application? 

e.g.  expected  results,  type  and  frequency  of  reports,  revenue  analysis,  etc.? 


BUDGETING 

If  computerization  of  General  Ledger  and  Financial  Statements  are  a  need  identified  by  the 
school  suggest  that  the  Budgeting  application  should  be  included  as  an  integral  part  of 
the  former  system. 

1)    What  information  and/or  statistical  breakdowns  do  we  need  for  budgeting  e.g.: 
-student  count  by  category  or  program  (ESL  pupils,  native  children,  etc.) 

-previous  years  financial  statements  by  department,  program,  cost  centre,  etc. 
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FINANCIAL  (GENERAL  LEDGER  AND  FINANCIAL  STATEMENTS) 

1)  Should  commitments  be  included  in  the  schools  financial  reports  i.e.  encumberance 
accounting  in  order  to  ensure  that  the  school  knows  where  it  stands  in  relation  to  its 
budget? 

For  example: 

Total  budget  -  (actual  expenditures  +  PO  commitments)  =  the  balance  available  in  the 

budget 

2)  Does  the  school  reguire  any  interface/integration  between  its  financial  and  student 
administrative  system? 

3)  What  type  of  G/L  coding  structure  does  the  school  envision? 

e.g.  EPSD  G/L  code 
or 

The  schools  own  G/L  code 

4)  How  many  G/L  accounts  does  the  school  now  use? 


CONTINUED 
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5)    What  objectives  is  the  school  seeking  through  computerization  of  its  financial  inform- 
ation i.e.  type  and  frequency  of  reports,  budget  analysis  etc. 


6)  How  many  different  fund  sources  does  the  school  have? 
e.g. 

EPSD  funds  (from  provincial  and  municipal  taxes) 

TRIM  funds  (Text  book  rental,  fees  and  instructional  materials) 

Special  project  funds  derived  from  school  initiatives  i.e.  car  washes, 
bottle  drive  etc.,  for  field  trips  (glee  club,  band,  soccer  team) 

Other 

7)  Does  the  school  require  separate  financial  statements  for  each  fund  it  is  responsible 
for? 


8)    Are  consolidated  financial  statements  required  by  the  school? 


9)    What  other  financial  information  does  the  school  need? 
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COMPUTER  ASSISTED  INSTRUCTION 


Obtain  a  general  description  of  the  schools  needs  and  expectations  in  this  area, 


Cost  Accounting 


1)  Could  the  schools  requirements  in  this  area  be  included  in  the  general  ledger  finan- 
cial statements.  If  not  obtain  a  conceptual  overview  of  the  type  of  cost  accounting 
information  required  by  the  school. 
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FIXED  ASSETS 

1)    What  general  class  of  items  does  the  school  want  to  include  in  this  application? 


2)    Are  the  school's  fixed  assets  currently  tagged  with  a  permanent  identifier? 


3)    Approximately  how  many  items  does  the  school  estimate  it  would  include  in  its  automat- 
ed fixed  asset  sysem? 


4)    Obtain  a  brief  conceptual  overview  of  what  the  school  expects  from  a  fixed  asset 
system. 


5)    What  type  and  frequency  of  reports  does  the  school  need  from  this  system. 
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INVENTORY  CONTROL 

1)    Does  the  school  have  a  central  storaqe  facility? 


2)    What  type(s)  of  inventory  and  how  many  items,  issues  and  receipts  does  the  school  wish 
to  control? 

e.g.    Automotive  shop 

Wood  shop 

Home  Economics,  etc. 


3)    Does  the  school  need  to  integrate  its  purchase  orders  with  inventory  control? 


4)    What  does  the  school  need  in  the  way  of  an  inventory  control  system? 
Describe  briefly. 
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LIBRARY  SERVICES 

1)    How  many  books  does  the  school  estimate  to  have  in  its  library? 


2)  Computerized  needs 

-Cross  Reference  by  Author? 

Title? 
Publisher? 
Subject? 
Key  words? 

-Checkout/Renewal 
-Returns 

-Overview  notices/lists 

-Fines 

-Other 

3)  Statistics  e.g.  usage? 

4)  Obtain  a  general  conceptual  overview  of  the  schools  needs  in  this  area. 
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PURCHASING 

General  requirements,  volumes  and  brief  conceptual  overview. 


WORD  PROCESSING 

Estimated  volumes,  frequencies 

Type  of  word  processing  needed  i.e. 
personalized  letters 
mass  mailings 
reports 

general  correspondence 
Try  to  determine  an  estimate  of  the  school's  current  work  load. 
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WORK  ORDERS 

Estimated  Volumes 

How  are  they  handled  now? 

Are  W/0*s  costed  out  e.g. 

labour  $ 
material  $ 

Are  W/O's  integrated  into  the  financial  system? 

General  conceputal  overview  and  description  of  system  needs. 


APPENDIX  3 
DETAILED   SCORING  COMPARISON  FORM 


SIMS  -  SELECTION  CRITERIA  -  LEVEL  3  -  Detaied  Scoring  Comparison  Form 


r  PRODUCT  3r  1 

SCORE  WEIGHTED 
SCORE 
(S)        (W  X  S) 



1  PRODUCT  2:  1 

1 

1 
( 

SCORE 
(S)        (W  X  S) 

1  PRODUCT  1 :  1 

1 

t 

c 
c 

ti 

SCORE 
(S)        (W  X  S) 

WEIGHT 
(W) 

CM 

m 

CM 

CRITERIA  ITEMS 

c 

( 

i 
s 

4J 

c 

1 

rH 
tH 

o 
u 
c 
u 

c 

1  " 
a  ^ 

•3  0) 

5  1 
S  0) 

Create  student  record 

Registration  confirmation  notice 
Feeder  school  confirmation  notice 

TOTAL  Pre-Reglstratlon/Enrollment 

Detailed  Data  Items 
Student  Information 
Instructor  Information 
Course  information 

TOTAL  Detailed  Data  Iteas 
Reports/Inc^ulries 

TOTAL  Iteports/Inqulrlee 
TOTAL  SCHOOL  RECORDS 

Manual  scheduling  (Arena  Scheduling) 

EVALUATION 

FACTOR 

PRODUCT 
SCOPE  & 
FUNCTION 

1  PRODUCT  3:  ll 

SCORE  WEIGHTED 
SCORE 
(S)         (W  X  S) 

1  PRODUCT  2: 

SCORE  WEIGHTED 
SCORE 
(S)         (W  X  S) 

PRODUCT  1: 

SCORE  WEIGHTED 
SCORE 
(S)         (W  X  S) 

WEIGHT 
(W) 

m 

ON 

o\ 

ON 

O 

01  ' 

00 

CRITERIA  ITEMS 

Pre-schedullng 

Course  Requests 

manual  entry 
automated  entry 

Edit  and  validation  of  course  requests 

Pre-scheduling  reports 

TOTAL  Pre-Scheduling 

Master  schedule  builder 

Capability  to  build  a  master  scheduler 

manually 

automatically 
Capability  of  handling  a  variety  of 
scheduling  units 

User  defined  timetable  rotation/tumble 
Flexible  number  of  nerloH*?  npr  Aav 
Capability  to  specify  exclusive  male  or 
female  sections 

Capability  to  maintain  current  and  future 
year/semester  master  schedules 

TOTAL  Raster  Schedule  Builder 

Scheduling  Process 

User  defined  scheduling  sequence 

Unscheduling  of  no-shows/withdrawals 

EVALUATION 
FACTOR 

(60) 


U3  C/2 

ai 

O  X 
O 

CO  S 


O  CO 


O  X 

o 

CO  :s 


O  CO 
CO 


Cx]  CO 

ai 

o  X 

C_) 

CO  3 


O  CO 
CO 


H 


re 

small 

nments 

ents 

(ensu 

after 
the 

S 

G  (0 
•H  TS 
O 

u 

t-i 

bO  no 

bO 

(0 

CO    0)  •H 

o 

o 

•H 

CO 

3 

4J 

C 
•H 

c  <u 

(U  CO 

4-) 

c 

iJ    CO  1.1 
CJ   I-l  (U 

u 

CO 

CO 

CO 

U 

a  3 

0)  3  a 

on 

iJ 

c 

CO 

c 

CO  ^ 

CO 

o 

o 

i 

(U 

•<-»  o 

•o 

<u 

bO 

o 

iH  CO 

cu 

bO  AJ 

I-l 

■§ "  s 

3 

t3 

CO 

C 

CO  4-1 

•H 

c 

(0 

•H 

CO   Ss  ^ 

4J 

3 

4.1 

tH 

a. 

^  C 

(0 

•H  bO 

0) 

3 

C  *J 

(0 

4J 

c 

iH 

3 

<U 

s 

rH  C 

•H 

cr 

0)  CO 

CO 

(U 

3 

O 

u  -o 

Q) 

3  -H 

I-l 

1.1  «f4 

•o 

•T3 

u 

<U  3 

(4-1 

TJ  *J 

(0 

•H 

oi 

O  bO  O 

flj 

>H 

3 

(U 

bo 

4J  4J 

1 

0)  U 

(0 

3 

o  c 

3 

iH 

4-1 

CO  CO 

CO 

J=  CO 

8 

cr 

bO 

•H  U 

•o 

(0 

CO 

CJ 

<o 

cu 

cu 

O  4-» 

c 

c 

U  r-i  0) 

•H 

CO 

S  M 

iH 

CO  CO 

2 

M 

•H 

O   3  ^ 

> 

4J 

•a 

(U  o 

(0 

CO 

*^ 

iH 

a 

(0 

<u 

0) 

o 

>S 

CO  ^-1 

q; 

a 

O.  O 

CO 

3 

cu  3 

t3 

CO 

rH 

o 

4J 

CO 

bflv-' 

(U  iH 

0) 

4J 

•o 

box  C 

C 

c 

0) 

3 

o 

CO 

•H 

bO  -O 

V4 

C 

iH 

bO 

M 

<U 

C  O 

•H 

0) 

I-l 

•o 

rH 

4J 

rH 

C  CO 

3 

•H 

bo^ 

3 

a 

O 

J= 

•H   CO  T3 

"O 

(U 

c 

•H 

•H  O 

o 

O 

c 

•a 

•H 

cx 

o 

o.  C 

«4-l 

3 

o 

j: 

O 

U3 

iJ  iH 

o 

c 

•H 

o 

H 

CO 

3  C4-I  CO 

O 

4.1 

u 

o 

4-1 

•a 

CO 

CO 

O 

U  4-1 

§ 

3 

O  O 

0} 

CO 

3 

a. 

bO  (U 

»H 

c 

M 

^4  C 

bO 

>^ 

>% 

4-1 

CO 

•H  CO 

O 

CO 

CO 

CO 

cu 

bo 

bO 

bO  O 

C 

M-( 

4-1 

>^ 

4J 

CO 

o 

(U  U 

iH 

4-1  4J 

o 

c 

•H 

4J 

•H 

o 

•H 

tH 

■H 

3  3 

bO 

CO 

•H  CO 

c 

u 

•H 

a  -H  w 

iH 

rH 

rH 

.-1 

r-( 

4J 

O 

c 

c 

fH 

CO 

CO 

iH 

O  rH  (0 

3 

CO 

•H 

OO 

•H 

iH 

u 

o;  u 

•H 

o 

•H  iH 

tJ 

3 

O  "H  C 

73 

o. 

X> 

•H 

^ 

CO 

CO 

CO 

•H 

CO 

43  O 

no 

o 

I-l  X 

(U 

3 

(0 

4-1 

CO 

J-) 

^1  C 

a 

u 

CO 

CO  O 

<u 

CU 

•H 

(U   CO  X 

O 

a. 

U 

cx 

>-l 

CO 

3  <U 

o 

O 

CO 

ax 

4J 

i 

JS 

c 

a  a  a 

o 

u 

CO 

CO 

CO 

O 

o  > 

iH 

(U 

•H 

CO  o 

4-1 

o 

3 

O  CO  O 

CO 

bO 

o 

a 

CJ 

«4-l 

Pi 

CJ  (U 

PQ 

CO 

CJ 

CJ  CO 

CO 

CO 

a  o  CJ 

>s  C 
U  9) 


C  T3 


CO  a 

3  O 

C  4-t 


H  csi 

<  o 

3  H 

J  CJ 

<  < 


(61) 


Q 

W  ^ 

H  Cd  C/5 

O  O  X 

M  O 

w  CO 


O  CO 
to 


Q 

H  M  CO 
O  O  X 

O 

u  CO  3 


O  CO 
CO 


Q 

u  ^ 

H  Cd  CO 

O  O  X 

M  O 

ti]  CO  :x 


O  CO 
CO 


CO 

4J 

<u 

a. 

•o 

>> 

4J 

0) 

nee 

a 

CO 

CO 

CO 

c 

<i) 

S 

CJ 

c 

•H 

u 

(0 

l-i 

H 

.£> 

•H 

M 

CO 

a  ^ 
a  L 

nb 

< 

"O 

c 

M 

<u 

73 

•H 

c 

Cd 

•H 

O 

CO 

H 

U-l 

O 

CO 

M 

4-1 

M 

0) 

(U 

iH 

O 

u 

•a 

l-l 

CO 

4J 

o 

o 

1 

> 

CO 

o. 

o 

•H 

(U 

se 

iJ 

te 

x: 

u 

3 

>% 

in 

ce 

ce 

(U 

•H 

c 

c 

iH 

r-l 

CO 

CO 

CO 

O. 

•H 

3 

TJ 

73 

•H 

o 

C 

C 

4-1 

CO 

•H 

<u 

cu 

rH 

cx 

u 

4-t 

3 

CO 

CO 

u 

4-t 

o 

> 

< 

<: 

l>i 

CO 

a> 

0) 

•o 

•H 

iH 

M 

•H 

•H 

3 

3 

CO 

^ 

bu 

xe 

M 

i-i 

rH 

■ — . 

•H 

i 

(0 

3 

CO 

CO 

4-1 

cr 

(0 

4-1 

M 

c 

4J 

4-1 

w 

O 

M 

(0 

§ 

a 

g 

•o 

•H 

CO 

o 

c 

4-> 

4-t 

4-1 

CO 

(U 

3 

T> 

s 

s 

o 

CO 

3 

CO 

CO 

o. 

4J 

X 

<u 

S 

CO 

(d 

H  ai 

<  O 

.J  a 

<:  < 

>  fa 
w 


(62) 


Q 

H  W  CO 

a:  Qi 

o  o  X 

W  C/3  s 


a 

H  u  w 
OS 

o  o  X 

t-l  cj 

tu  w  3 


Q 

W  ^ 

H  td  CO 

o  o  X 

M  u 

cx3  CO  :s 

12  w 


2 

O 

H 

CO 

H 

O 

o 

H 

H 

AND  F 

O  T  IW  D  A 

V  ll«Co 

M 

7S 

Pi 

O 

M 

O 

M 

u 

CO 

u 

CO 

CO 

D 

AL 

i 

H 

Pm 

H 

CJ 

O 

H 

04 

D 

O 

M 

O 

M 

cd 

04 

H 

O 

CO 

o 

04 

O 

•<J 

tn 

P 

(0 

&4 

M 

H 

CO 

iH 

(U 

tro 

>J 

M 

O 

c 

<s 

< 

<3 

U 

o 

M 
h3 

H 

H 

H 

H 

Res 

o 

O 

O 

O 

O 

\ 

>% 

M 

H 

H 

H 

H 

u 

a 

•H 

Q 

O 

Q 

A 

3 

2 

95 

95 

O 
CO 

3 
O 

<u 

i 

RA 

RA 

RA 

< 

PA 

PQ 

CO 

u 

O 

o 

z 
o 

M 

H  oi 

<  O 

D  H 

►J  U 

<:  < 
w 


CO 
H  Cd 

O  M 

II 

CO  CO 


(63) 


U  CO 

2  o  X 
o  o 

U  CO  3 

CO  w 


a 
u 
H 

o  ^ 

M  CO 


u  CO 
o  u 

CJ  CO  3 

CO  w 


U  CO 

U  C5C{ 

3  o  X 
o  o 

U  CO  3 

CO  ' 


o 

M 

H 

<} 

O 

M 

M 

hJ 

<! 

C3 

c 

H 

O 

D 

o 

Q 

O 

> 

<J 

H 

H 

O 

O 

H 

H 

2 

o 

o 

M 

H  as 

<  O 
=3  H 

<  < 

>  ft, 


O  M 


